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ABSTRACT 



A method is disclosed for describing functionality of an . 
interactive multimedia application for use on an interactive 
network. The method includes the step of storing at least one 
composite description in an ASCII text file. The composite 
description describes a single multimedia presentation. The 
composite description includes at least one composite item 
selected from the group consisting of text, box, font, 
graphic, video, audio, animation and list. A system is also 
disclosed for implementing the steps of the method. 
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METHOD AND SYSTEM FOR DESCRIBING 

FUNCTIONALITY OF AN INTERACTIVE 
MULTIMEDIA APPLICATION FOR USE ON 
AN INTERACTIVE NETWORK 

CROSS-REFERENCE TO RELATED 
APPLICATIONS 

This application is a continuation of U.S. patent applica- 
tion Ser. No. 08/372,159, filed Jan. 3, 1995 now abandoned, 
which is related to U.S. patent application Ser. No.: 08/915, 
188, entitled "Method And System For Preloading Prefetch 
Data Of A Multimedia Application In An Interactive 
Network," which is a continuation of Ser. No. 08/372,152, 
now abandoned; Ser. No. 08/372,153, entitled "Method For 
Automatically Collecting Semantic Event Data In An Inter- 
active Network," now U.S. Pat. No. 5,752,159; Ser. No. 
08/372,157, entitled "Method And System For Managing 
Multimedia Assets For Proper Deployment On Interactive 
Networks," now U.S. Pat. No. 5,743,956; and Ser. No. 
08/659,430, entitled "Method And System For Developing 
Interactive Multimedia Applications For Use On An Inter- 
active Network," which is a continuation of Ser. No. 08/372, 
158, now abandoned. The related applications are com- 
monly assigned to the assignee of the present application 
and are hereby incorporated by reference. 

TECHNICAL FIELD 

This invention relates generally to methods for describing 
multimedia applications and executing such applications on 
an interactive network. 

BACKGROUND ART 

Recently, the deployment of interactive networks, includ- 
ing broadband television and computer networks, is occur- 
ring at a rapid pace. This increase in the number of inter- 
active networks has created a need for the rapid 
development of accompanying multimedia applications to 
be executed on such networks. 

Traditionally, multimedia applications have included 
audio/video assets and have been developed using a low 
level language such as C or C++. Although authoring 
packages have provided the facility to develop portions of 
applications in higher level languages, the prior art still 
relies on custom programming to support the entire appli- 
cation. 

As a consequence of their low level and customized 
nature, employing the prior art methods to develop multi- 
media applications is not only time consuming but also 
results in applications which are difficult to support. Further, 
the multimedia applications developed using the prior art 
methods are customized to operate on specific hardware. 

DISCLOSURE OF THE INVENTION 

In view of the prior art, a need exists for a method for 
more efficiently defining multimedia applications which 
may be executed at a client station. 

It is an object of the present invention to provide a method 
for describing the functionality of a multimedia application 
which results in reduced development time. 

It is another object of the present invention to provide a 
method for developing a multimedia application which may 
be executed at a client station regardless of the hardware 
manufacturer. 

In carrying out the above objects and other objects of the 
present invention, a method is provided for describing 
functionality of an interactive multimedia application for use 
on an interactive network. The method includes the step of 
storing at least one composite description in an ASCII text 
file. 
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The composite description describes a single multimedia 
presentation. Further, the composite description includes at 
least one composite item selected from the group consisting 
of text, box, font, graphic, video, audio, animation and list. 
5 Preferably, the composite description also includes at least 
one event handler selected from the group consisting of 
timerEventHandler, buttonEventHandler, 
streamEventHandler and compositeEventHandler. 

The present invention provides many advantages over the 
10 prior art. These advantages include more efficient applica- 
tion development; portability of applications; improved 
facility for error detection; and automated generation of 
applications (i.e. from asset databases). 

In further carrying out the above objects and other objects 
15 of the present invention, a system is also provided for 
carrying out the steps of the above described method. 

The objects, features and advantages of the present inven- 
tion are readily apparent from the detailed description of the 
best mode for carrying out the invention when taken in 
20 connection with the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

A more complete appreciation of the invention and many 
of the attendant advantages thereof may be readily obtained 
25 by reference to the following detailed description when 
considered with the accompanying drawings in which ref- 
erence characters indicate corresponding parts in all of the 
views, wherein: 

FIG. 1 is a schematic block diagram of the environment 
30 in which the present invention is used; 

FIG. 2 is a schematic block diagram illustrating the 
preferred architecture of an interactive television network 
employing the development method of the present inven- 
tion; 

35 FIG. 3 is a schematic block diagram illustrating the 
relationship between various file formats and the runtime 
component of a set top terminal; 

FIG. 4 is a functional block diagram illustrating the 
relationship between components of the Asset Management 
4Q and Production System of the preferred embodiment; and 
FIG. 5 is a block diagram illustrating the layered archi- 
tecture employed by the preferred embodiment. 

BEST MODES FOR CARRYING OUT THE 
INVENTION 

45 

Referring now to the drawings, FIG. 1 is a schematic 
block diagram illustrating an interactive television ("ITV") 
system 10 for use with the present invention. System 10 
includes at least one ITV server 110 for use with an ITV 

5Q network 112. ITV server 110 is connected through ITV 
network 112 with client station 114. 

There are a number of equipment manufacturers who 
produce commercially available equipment which could 
function as ITV server 110. In fact, the control logic employ- 
ing the method of the present invention has been success- 

55 fully implemented on DEC Alpha AXP processors running 
DEC OSF/1; SGI mips-based processors running IRIX; and 
SUN processors running SunOS. 

The control logic has been implemented in both C and 
C++. If necessary, it could be easily ported to other UNIX 

60 platforms. 

Client station 114 includes set top terminal 116, television 
118 and remote controller 120. Preferably, set top terminal 
116 would be either a Time -Warner full service network 
Home Communications Terminal ("HCT") or a 3DO set top 
65 terminal . The Time Warner HCT employs a MIPS R4000 
chip running at 80-100 MHz and incorporates Silicon 
Graphics Indigo Workstation components. 
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The 3DO set top terminal employs a proprietary 3DO chip 
set. The control logic communicating with the 3DO set top 
terminals conform to the 3DO RPC Folio, as described in the 
"3DO Network Developer's Guide — Preliminary Draft", 
dated July, 1994. 5 

Both terminals, Time Warner and 3DO, are capable of 
receiving digital full-motion video, animation, graphics and 
audio data. Both terminals are further capable of converting 
this digital information into an analog signal for transmis- 
sion to television 118. 

Client station 114 further includes an input device 120. 10 
Preferably input device 120 is an infrared remote control 
including a number of alpha-numeric keys. Alternatively, 
input device 120 could be an infrared mouse. 

As those skilled in the art will recognize, system 10 is an 
interactive television network employing a client-server 35 
architecture. ITV server 110 provides mass storage and 
services to client station 114. Control logic resides at both 
server 110 and client station 114 to support the client-server 
architecture. 

Although the preferred server 110 and client station 114 
are part of an interactive television system, the present 20 
invention is not limited to such an embodiment. For 
example, client station 114 could be a kiosk or personal 
computer without adversely affecting the utility of the 
present invention. 

Referring now to FIG. 2, there is shown a schematic block 25 
diagram illustrating the architecture of the Information Ser- 
vices Infra-Structure ("ISIS") employing the application 
development method of the present invention. ISIS provides 
a set of interoperable software tools for developing and 
executing interactive multimedia applications for delivery 3Q 
on a variety of consumer electronic devices over a variety of 
broadband networks. 

The ISIS architecture includes two categories of software 
components: development components 210 and runtime 
components 212. Development components 210 include 
authoring and application publishing tools for building a 35 
multimedia application. 

The authoring tools work with existing asset creation and 
production tools such as Adobe Photoshop, Adobe Premier, 
and SoundEdit Pro which can be used to create videos, 
graphics, audio, and fonts. An authored application can be 40 
compiled and tested it in either a standalone Macintosh 
configuration or a client/server environment over a network. 
The application publishing tools move the application from 
a standalone environment to a server environment and to the 
eventual deployment/production environment. 45 

The ISIS runtime components 212 are responsible for 
executing an authored application. ISIS runtime components 
212 provides the execution environment for the application 
in a client/server environment where the client device is a 
consumer set top terminal. In order to support emerging 50 
consumer set top terminals, as well as Macintoshes and PCs, 
the developed applications are portable. 

The initial focus of ISIS was to deliver 3DO runtime 
software for the U S WEST Broadband network trial in 
Omaha, Nebr., in the fourth quarter of 1994. A Macintosh 55 
version of the runtime components is also supported to allow 
testing of applications without expensive 3DO or DEC 
development hardware and software. 
Composite Authoring Tool (CAT) 

Referring now to FIG. 3, there is illustrated the relation- 
ship between CAT 214, composite compiler 310, various file 60 
formats and the ISIS runtime component module 234 of set 
top terminal 114. CAT 214 is an authoring tool that runs on 
the Macintosh and defines the compositing of multimedia 
assets (i.e. video, graphics, audio, and text) into interactive 
multimedia applications. CAT 214 provides an integrated 65 
graphical layout editor, a forms editor, and a testing envi- 
ronment. 



With the layout editor, display objects can be easily 
defined and laid out in a window that represents a television 
screen. Each display object also has a detail forms window 
in which additional object attributes can be specified. 

CAT 214 provides a seamless testing environment on the 
Macintosh which is integrated with a composite compiler 
and the Macintosh version of the runtime components. CAT 
214 invokes composite compiler 310 to compile the 
composite, and then invokes ISIS runtime module 234 to 
execute the composite. A new composite can be created and 
tested with a few clicks of the mouse. 

CAT 214 delivers a source composite definition 226 and 
a binary composite definition 228 as output in Composite 
Description Language ("CDL"). CDL provides an event 
driven, object oriented syntax for defining a multimedia 
application. 

CDL source files are stored in ASCII format, which makes 
it easy to read by any program that can read ASCII text files. 
CDL source files can be generated by CAT 214 and edited 
by custom built authoring tools or any editor capable of 
handling ASCII text files. 

composite compiler 310 converts CDL from a source 
format into a more compact binary format. ISIS runtime 
module 234 then reads and executes the instructions of the 
application in this binary format. 

Composite compiler 310 includes a composite optimizer 
which condenses multiple composite files and assets refer- 
enced by the composite to a single composite binary file. 
Reducing the number of physical files within the application 
reduces the number of file accesses the ISIS runtime module 
234 must perform to execute a composite. File accesses are 
expensive, especially in a network environment because of 
network latency. 

Composites, composite items, events, actions, and tem- 
plates are the building blocks of CDL and any application 
built in ISIS. 

Composite A composite is a collection of assets, events and 
actions assembled into a "scene" that the ISIS runtime 
module 234 plays back, composites can also contain other 
composites. To describe interactivity, a composite defines 
how to handle external events such as button presses on 
a remote control. 
Composite item A composite item is a multimedia object 
(i.e. video, graphic, text, audio, animation or custom 
library) within a composite. Attributes such as screen 
location, transparency and audio and video looping fur- 
ther define composite items. 
Event An event is an occurrence to which an application 
must react. Events can occur externally or internally to the 
ISIS runtime module 234. Button presses on a remote 
control are external events. The passage of time, entering 
a composite and starting a stream are internal events. 
As ISIS runtime module 234 plays back a composite, it 
also monitors events as they occur. When an event 
occurs that is of interest to the executing composite, the 
ISIS runtime module 234 executes the actions associ- 
ated with that event. An event always has at least one 
action associated with it. 
Action CDL has predefined actions that the ISIS runtime 
module 234 player can perform. For example, a common 
action for composite items is "enable." The enable action 
tells the ISIS runtime module 234 to display a graphic, 
play an audio file, etc. 

Another common action is "transition torcomposite" 
which tells the ISIS runtime module 234 to execute the 
composite defined by the "transition to" action. In 
effect, these transitions link composites together into an 
application. In addition to the predefined actions that 
ISIS provides, a developer can write and add custom 
actions. 
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Composite Templates composites can also be templates. Any handler opens a composite when the "Select" button is 

composite can take its composition from another com- pressed. The "Open" action leaves the current composite 

posite simply by referencing that composite as a template. open, overlaying it with the newly opened composite, 

composites inherit (using a delegation mechanism) all Templates 

items, events, and actions from a template. 5 Each composite may reference one or more template 

COMPOSITE DESCRIPTION LANGUAGE ^^t^ 

CDL source files require a syntax compatible with com- chain" 

posite compiler. The syntax is largely free-form, but must be When a composite ^ displayed, all the items in the 

created using the keywords. composite and the template chain are displayed. When 'an 

In addition, a number of implementation-specific terms 10 event or handler occurs, the composite and each of the 

are used throughout this application. composites in the template chain are searched to find a 

To illustrate the use of CDL to describe multimedia matching handler. When an item is referenced by an item 

applications, consider the following example: name, the composite and each of the composites in the 

(composite: name "acme: shoeslntro.comp": template template chain are searched for a matching item. The 

"acme:deptIntro.comp" (video : rectangle (0,0,340,252) override attribute can be used to change the way that the 

:file "acme:shoesIntro.video":name "intra Video" :layer 1) template chain is searched for event handlers. 

(graphic :rectangle (20,20,90,60) :file "acme:shoesIntro- The purpose of creating template composites is to share 

:marchShoeSale.bitmapn :layer 2) (streamEvent :stream appearance and behavior among many different composites. 

"introVideo" :eventType StreamEnd :action nTransition- l } 15 « wa y t0 f *f tor ™ the comm0D V™*-*™ *™ m &> » 

* . " « , • m\ developer might want to use a common background and set 

Ton :actionParameters acme: shoes: spnng.comp )) 2Q . of butl0QS in the ^0^5 for xytST al different products. 

In this example, the "acme:shoeslntro.comp" composite 0ne way t0 accomplish this would be to put the background 

includes three composite items: a video, a graphic and an and tne buttons in a template composite and then reference 

event handler. It also inherits any items in the template this template from the composite for each product. In this 

composite which is named "acme:deptIntro.comp ." The way, each product composite would only contain items that 

event handler executes the action "TransitionTo" on the end are unique to that product. A simple template example might 

of the video item — transitioning to the "acme:shoes: 25 be: 

spring.comp" composite. This example demonstrates a (composite :name "Example .composite" # this composite 

graphic in layer 2 overlaying a video in layer 1. All of the puts up a piece of text on top of # the US West background 

items are enabled upon entry to the composite. template "USWestBackground.composite" 

(composite: name "acme.comp" template "theStreet.comp" ( text ;t ex tValue "My first composite" :rectangle (20 20 270 

(text :textValue "ACME Department Store" :textSize 24 30 

:rectangle (20,210,300,30) ) :layer 9 :shared true) (audio (composite :name "Background .composite" 

:name "storeMusic" :file "acme:springTune.audio") # m js composite displays a nice logo in the background 

:shared true) (timer :time 300:action "TransitionTo" (graphic :rectangle (O O 320 240) :filename 

:actionParameters " ©customer AsleepCompositeltem") "USWestLogo") 

(value :name "customerAsleepCompositeltem") :text 35 # and prov j des a button that quits the application (text 

"acme:areYouThere.comp") :textValue "Exit" :rectangle (100 150 270 170)) 

This second example, the "acme.comp" composite illus- (hilite :rectangle (95 145 270 170) :action "Quit") 

trates what appears to be a template composite to be used Application Publishing 

throughout the ACME Department Store presentation. It The ISIS application publishing tools 216 are utilities that 

inherits any items from the template composite named 40 move an appli cation between a test environment and a 

"theStreet.comp" which, perhaps, contains application-wide deployment environment. These tools move all the objects 

items. The text item appears to contain a text logo to be of an ISIS applicat i on including composites, video, graphic 

displayed throughout the store, and the audio item seems to and audio files? fontSj and custom ^ 

contain background music that can be shared across com- Application publishing tools 216 examine composite 

posite transitions. The timer appears to implement a user 45 descriptions, determine all the files that support the 

interface that checks with the viewer if they stay in a compos ites, arid move the application to a staging area such 

composite for more than five minutes (300 seconds). The as t or disk From the staging area, the application can be 

associated action transitions to a composite whose name is moved lQ a variety of env i ronme nts. 

stored in the "customerAsleepCompositeltem" value item. ISIS also supports incremental publishing. Using incre- 

The use of indirect specification of the target composite me ntal pubhshing, only those objects that have been altered 

allows individual composites to supply their own "custom- since the last publis hing of the application are moved. This 

erAsleepCompositeltem" item with a text value that is lets the developer add new features and change content 

different than the default ("acmeareYouThere.comp"). quickly 

(composite:name "acme:bronzeWidgets.compl": template Assc{ Management and Production System (AMPS) 

"acme:product.comp" (video :name "videol" :rectangle The IS IS Assct Management and Production System 

(0,0,340,252) :file "acme:bronzeWidgetsDemo.video" 55 (AMPS) 218 provides a set of tools for managing multime- 

:enabled true) (event: stream "videol" :eventType Strea- dia 230 and ISIS applications. AMPS 218 provides 

mEnd action "Enable" :actionParameters "video2") multimedia title developers with an easy and convenient 

(event :button ButtonSelect :eventType ButtonPressed way to catalog assets, perform keyword searches on assets, 

: action "Open" :actionParameters "acme: salesScreen. archive assets and publish applications. AMPS 218 moves 

comp") (video :name "video2":rectangle (0, 0, 340, 252) 60 applications and assets from a development environment to 

:file,"acme:bronzeWidgetsClose.video" .enabled false)) a deployment environment. 

In the third example, the "acme:bronzeWidgets.comp" Referring now to FIG. 4, there is a functional block 

composite illustrates the use of enabled and disabled items. diagram illustrating the relationship between components of 

Item "videol" is initially enabled, whereas "video2" is not. AMPS 218 of the preferred embodiment. 

The stream event handler takes care of enabling "video2" 65 Asset Registration 

when the first video completes. Note that "videol" is implic- Asset registration 410 allows the developer to identify and 

itly disabled when it is over (StreamEnd). The button event catalog an asset or group of assets with AMPS 218. The 
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developer can also assign keywords to the asset during the The ISIS development components 210 finally include an 

registration process. The developer can register assets manu- interface to standard facilities such as asset creation/ 

ally using asset registration screens. Speedport 220 also uses production 222 and custom authoring tools 224. 

the asset registration function to allow the developer to ISIS Runtime Components 

register assets in an automated fashion. 5 A major component of the ISIS runtime components 212 

Asset Search and Retrieval is the ISIS runtime module 234 which resides at client 

The asset search and retrieval function 412 allows the station 114. ISIS runtime module 234 reads and plays back 

developer to perform keyword searches of the asset data- composite binary files 228 defined during the authoring 

base. Asset retrieval supports the browsing of assets and/or process. It reads the startup composite, waits for events to 

using the asset within a multimedia application. CAT 214 occur, and then executes the actions associated with those 

integrates with the asset search and retrieval function 412, 10 even ts 

providing the developer an easy and convenient way to ^ majof processing components of ISIS 

locate assets during the authoring process. mntime module 234. the player; the pre loader and the event 
Asset Conversion 



collector. 



Multimedia assets come in many different formats. The M ^ heaft of tfae module the { 

ISIS asset conversion tools 414 convert assets from one 



handles the display and playback of composite items, moni- 



format to another as specified to the conversion process. A , ors and handles events B th performs actions, and 

wide variety of formats are supported, including virtually all communicates witn the pre ioader and event collector as 

of the more commonly used formats today. needed 

In general, the runtime platform requires assets to be in a ^ preloader ides the ISIS runtime module 234 ^ 

certam format. For example 3DO supports a format unique an overa „ mem management and caching whose 

to the 3DO environment, called a CEL. The asset conversion e fa tQ ^ performance md t0 me latency . 

took 414 convert assets from a wide variety of formats into when aQ application starts Md ^ player invokes me first 

ce * . , . . , , , composite, the preloader retrieves all of the files necessary 

Conversions can be run against a single asset or m batch tQ j me osite It men looks at the ^posite and 

against multiple assets. The converted asset 1S automatically ^ ^ „ next „ sites based on ^ transitions defined 

regBtered with AMPS 218 as a new version. 25 ^ ^ tha f is playing 

Asse Arctnvat The event collector stores all internal and external events, 

Asset archival 416 performs backup and recovery of as lh oaw ^ in a buffer in me al client sta[ion U4 

assets. Asset archival 416 also moves assets off of faster events can ^ ^ tQ the 6V6nt coUector m Qn , he 

magnetic disk devices to slower devices such as magnetic aHyu for logging t0 a file or for additional processing. 

' a Pfj ... - , . . ...... 30 The event collector captures the event information in 

The archival of assets to slower devices provides signifi- enou ^ detail ^ that ISIS mntime module 334 can ^ , he 

cant cost benefits while still making the assete available to event { tQ , back an application xssion exactly ^ it 

users of the system. Users are still able to perform keyword appeared to the end ^ isis runtime module 234 is both 

searches and view thumbnaik on the archived asset. If the act and portable . Currently the total size of ISIS 

user wants to use the archived asset and it has been archived 35 ^ module 234 ^ approximately 200 KB. 

li^!l.^^ 0 2 ^ml h ?.^ b ^ ApplicationsdevelopedusingthelSISdevelopmentcom- 

ponents 210 are easy to port to any client station equipped 
with ISIS runtime module 234. ISIS accomplishes this by 



disk. Otherwise, AMPS 218 notifies the user as to the 
location of the asset 

AMPS 218 also performs backup and recovery of assets ™^ th7 la^ereT^ 

to magnetic tape allowing the user to recover a previous Applications written in CDL are hidden from the details 

version of an asset or restore an asset which may have been of the hardwarej operating system software, and ISIS runt- 

accidentally deleted. ime £ven if ISIS mntime mQS 0Q a client station with which 

Speedport lools the developer ^ un famiUar, the CDL portion of the appli- 

Speedport 220 is a component of the ISIS tool set that. cation mns any changes . 

transforms existing multimedia applications into ISIS apph- Xhere are other ieces of the app ii ca tion, however, that 

cations. Speedport 220 provides tools to systematically 45 might require changes in order t0 execute on different client 

extract multimedia assets from existing titles and to register sta tions. The changes might include reformatting and 

those assets with AMPS 218. Speedport 220 also provides a re -encoding assets and converting fonts, 

methodology and practical guidance for converting the While tne besl mode for carrymg out the invention has 

application into an ISIS application. been described in detaiI> those familiar with tne art to which 

Speedport 220 speeds up the conversion of any existing 50 this invention relates will recognize various alternative 

multimedia application. Speedport 220 accepts a variety of desi and embodiments for practicing the invention as 

digital media including CD-ROM, magnetic disk, optical defined b the flowing claims, 
drives, and digital tape. 

Speedport 220 also defines a methodology or set of DEFINITIONS 

practices for porting application to the ISIS environment 55 Composite: A Composite describes a presentation element 

J-his methodology guides the developer through the steps of ^ 

can be "played" bv the ISIS runtime It is stored on a 

moving application components from the existing environ- . a f A , u 4 . C1 lt . , , . 

ment into ISIS server in a file identified by the filename. It includes a list 

me ^en 0 performing asset extraction, speedport 220 first of Composite Items that provide the visible and audible 

searches the existing application and identifies multimedia aspects of the presentation as weU as the behavior that will 

assets from the set of files input to speedport 220. This 60 be exhibited in response to events during the runtime 

includes a variety of graphic, audio, and video file formats. session. 

Next, speedport 220 converts and renames the assets into filename: A filename is a string used to uniquely identify a 

a format usable by CAT 214 and the Macintosh runtime file on the server. The file may contain a composite, 

module, speedport 220 then registers both the source' and primitive multimedia asset or other application file. It 

converted asset with AMPS 218. Finally, speedport 220 65 must be enclosed within double quotes. 

generates reports identifying assets extracted by type and a template/templates: Each composite may reference one or 

list of unknown types. more template composites from which it can inherit 



04/01/2004, EAST Version: 1.4.1 



US 6,415303 Bl 

9 10 

composite items. A template composite usually contains to the composite. The default is false. Setting this attribute 

composite items used by many different composites. If gives the user feedback about the composite they are 

there is more than one template the items are added in the about to see without waiting for all of the items in the 

order of the templates in the list. composite to be loaded, 

compositeitem: Each composite may contain any number of 5 oox: A box composite item is used to draw a box on the 

composite items. The different items are used to present screen. The rectangle attribute determines the position 

multimedia assets and to specify responses to events in and size of the box - The foregroundColor attribute deter- 

the runtime session. The items may be listed in any order, mines tne color used to ^ box i the default fore - 

which has no bearing on the order of their processing by groundColor is white. The thickness attribute determines 

the runtime 10 thickness of the frame; the default thickness is 0. The 

compositeltemType: Each composite item has a type which u^T^n th f Colo t r ™* d t0 * U in the 

determines its handling by the runtime. The range of types *° X 'l f , default ba ^ ound transparent. 

w -1 f , • i • t i ji" „ text: A text composite item is used to presetn text in a 

provides for presen ing media assets handling events, fectan ^ e 0Q £ SCfeen ^ ^ ig ^ {q 

setting timers, identifying action routines and storing stfing format and ^ rendered ^ me cified fom 
static data associated with the composite. is When the item is enabled, the text will be rendered on the 

itemName: A composite item may optionally be assigned an screen> If a background color is specified, a box is drawn 

itemName that provides a unique identifier. The name behind the text in that color. The size of this box can be 

allows actions to refer to the named item. Actions may controlled by specifying the :rectangle, and if only a 

refer to composite items for performing such operations position is specified, the box will be auto-size around the 

as enabling/disabling, starting a timer and getting static 20 text. The foreground color is the color the text is drawn in. 

data values. Th e ;leftMargin and :topMargin allow offsetting of the 

enabled: Each Composite Item is either enabled or disabled. text from the upper left comer of the box. Wrapping 

When an item is enabled, it is processed by the runtime. allows word-wrap inside of the defined :rectangle. 

For example, an enabled graphic will be displayed on the justification: This optional attribute affects the layout of text, 

screen; an enabled timer will be started. On the other 25 The default, "top" and "left", causes each line of text to 

hand, a disabled item is not processed. So a disabled event start at the top and left margin. The "center" option causes 

handler will not fire on its associated event. Event handler each line of text to be centered between the left and right 

actions may dynamically enable and disable composite margin. 

items. This optional attribute controls whether an item is lineSpacing: This optional attribute affects the spacing, in 

processed when the composite is first entered by the 30 pixels, between lines of text. The amount is added to the 

runtime session. If not specified, the item is initially normal line spacing for the font. The default is 0. 

enabled by default. characterSpacing: This optional attribute affects the spacing, 

group: A compositeitem may be tagged as part of a com- in pixels, between characters of text. The amount is added 

positeitem group. Certain operations that act upon com- to the normal character spacing for the font. The default 

posite items allow a group to be specified. This is an 35 is 0. 

optional attribute. maximumLength: This optional attribute limits the maxi- 

shared: This optional attribute allows a shared composite mum number of characters that can be entered into a text 

item to remain enabled whenever the runtime transitions input field. If the user goes over the limit, a "Textlnput- 

to another composite that also contains the same item (if MaxFail" message is sent. This can be handled by a script 

it is flagged as initially enabled). This allows video, audio 40 or custom action of that name. 

and other stream presentations to remain open across font: A font composite item is used to map a single string to 

composite transitions. This can be used to implement a system dependent font specification, and ensures that 

features such as shared background audio. the font is loaded when required. For example (font :name 

layer: The layer attribute is used to control the relative Geneval2 :file Geneval2.3do), where Geneval2.3do is a 

positioning of a visible or audible compositeitem. Lower 45 system specific font file. Different sizes and styles of a 

number layers are "in front" of higher number layers. For typographical font are different fonts in a composite, 

visible items, a lower layer puts the item visually in front Geneval2 and Geneval4 are two completely different 

of other layers. For audio items, layers are numbered such fonts. 

that if two items are enabled concurrently, the item in the color: Acolor is specified as an RGB (red, green, blue) triple, 

frontmost layer will play while the other will be muted. 50 graphic: A graphic is used to display a bit-map graphic in 

transparency: The transparency attribute is used to control a rectangle on the screen. The graphic is stored in a file on 

the how much of the background is visible beneath a the server in a format that depends upon the client device, 

visible compositeitem. This is specified as a number from This file can be specified directly in the item as a filename, 

0 to 100. A value of O means the item is opaque and a or it can be indirectly obtained by specifying a value 

value of 100 would be completely transparent. The default 55 composite item which contains the filename. When the 

k item is enabled, the graphic will be rendered on the 

transparentBlack: The transparentBlack attribute is used to screen. 

determine whether black pixels in an image are visible or video: A video composite item will play a video stream with 

transparent. This is used to easily display images that have associated audio. The video will appear in a visual plane 

non-rectangular edges. The default is false. 60 on the screen. On some networks, the developer may be 

override: For event composite items, the override attribute constrained to the very back visual plane, in which case 

determines whether the system should continue searching the specification of a layer for this item will be ignored, 

in the composite and it's templates for other event items Otherwise the layer attribute for this composite item will 

that match. The default value, extend, continues search- control the visual plane in which the video is rendered, 

ing. The other value, replace, stops searching. 65 The video is stored in a file on the server in a format that 

preview: For visible composite items, the preview attribute depends upon the client device. This file can be specified 

determines whether the item is drawn during the transition directly in the item as a filename, or it can be indirectly 
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obtained by specifying a value composite item which con- 
tains the filename. When the item is enabled, the video will 
be played. 

The loop attibute will control whether the video plays in 
a continuous loop or whether it plays only once and then 
stops. The default is to play only once. 

The keepResident attribute will control whether the set- 
top will try to load the entire video into memory or whether 
it loads the video as needed. The default is to load the video 
as needed. 

The lastFrameSt ays Visible attribute controls whether the 
last frame of the video remains visible on the screen when 
the video ends or whether it is erased. The default is to erase 
it. 

audio: An audio composite item is used to present audio on 
the client device speaker. The audio is stored in a file on 
the server in a format that depends upon the client device. 
This file can be specified directly in the item as a filename, 
or it can be indirectly obtained by specifying a value 
composite item which contains the filename. When the 
item is enabled, the audio will be played. 
The layer attribute will control the interaction between 
this piece of audio and any other enabled audio. When 
multiple audio items are enabled, the runtime will play only 
items in the "frontmost" layer, and will stop playing any 
others. If two pieces of audio are enabled in the same layer, 
the runtime will play only the most recently enabled item. 

The loop attibute will control whether the audio plays in 
a continuous loop or whether it plays only once and then 
stops. The default is to play only once. 

The keepResident attribute will control whether the set- 
top will try to load the entire audio into memory or whether 
it loads the audio as needed. The default is to load the audio 
as needed. 

. list: A list is used to display a visual menu of items. The list 
object is most useful when the number of items to be 
displayed is more than a screenful. It is specified by: 

1) a starting position and a sequence of view position 
offsets; 

2) options that control the behavior of the list; 

3) an item template that specifies the look and feel that is 
shared by all displayed items of the list; 

4) a value string that is used to instantiate the template; or 

5) an optional initial state of the list. 

The starting position of a list can be specified by :position 
or : rectangle. In any case, only the top & left value is used 
by the list. The :positions attribute specifies the view posi- 
tion offsets where list items will be displayed. The number 
of offsets in the sequence is the maximum number of items 
that will be displayed at any given time. 

There are a number of options that can be used in 
combination to create a wide variety of list presentations. We 
will describe each attribute and some commonly used com- 
binations. 

If :wrapCiirsor is set to true, then the list behaves as a 
circular list with respect to cursor movements. Otherwise, an 
attempt to move the cursor beyond the range of fist items 
generates a ListCursorNextFail or ListCursorPrevFail mes- 
sage. We will cover later how such messages can be handled 
in a composite. 

If :wrapList is set to true, then the list behaves as a circular 
list as far displaying the items. When used in combination 
with iwrapCursor, although it does not have to be that way, 
it behaves as a true circular list. This attribute has no effect 
when enough view positions are available to display all list 
items. 

In the default case, the list cursor moves from item to item 
under user control. To get a visual appearance of cursor 
being in a fixed position and the list moving beneath it, set 
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rfixedCursor to true. In that case, rfixedCursorlndex should 
be set to the index (starting from O) of the view position that 
will have the fixed cursor. 

The list handles a number of messages which we will 
discuss later. On of them is ListDelete which is sent to the 
item that has the cursor. The item that gets this message is 
then marked as disabled. If the item was already disabled, 
then a second ListDelete message enables the item. 
However, if :hideDisable attribute is set to true, then dis- 
abled items are not displayed. There is no possibility of 
reenabling a hidden item because it can never get the cursor. 

A list item that has the cursor can be selected by sending 
a ListSelect message. In the default case, any number of 
items can be selected. However, if :singleSelect is set to true, 
then at most one item can be selected. Any previously 
selected items are deselected. 

In a list that does not have fixedCursor attribute set, the 
following attributes are meaningful. If the :autoScrollMar- 
gin is 0, which is default, then there is no autoscrolling. Only 
when cursor is moved to an item that is not displayed the list 
is scrolled to bring the cursor item into view. For a positive 
value of autoScrollMargin, whenever the cursor moves to an 
item that is within the specified margin from top or bottom 
of the list, the list is scrolled by :autoScrollCount items in the 
direction of cursor movement. Another control parameter for 
a list is the amount of "white space" or unfilled view 
25 positions that are remaining at either end. The :max- 
WhiteSpaceBelow and :maxWhiteSpaceAbove attributes 
are used to limit the maximum amount of white space below 
and above a list. The list is scrolled up or down to satisfy the 
constraints. When both constraints are violated, the max- 
30 WhiteSpaceAbove constraint takes precedence. 

Regarding the :itemTemplate attribute of list, the template 
specifes a set of elements which taken together account for 
the behaviour of the item. There is no limit to the number of 
elements in itemTemplate. Each element references and 
controls a composite item. The element has a condition, 
:cond, under which it will fire, and then the composite item 
it control is enabled. When the condition does not hold, the 
composite item is disabled. There are two kinds of 
conditions, edge and state conditions. The edge conditions 
are OnAction and those that end,with "In" suffix, and they 
40 fire the first time the condition becomes true. The remaining 
conditions are state conditions and they fire as long as the 
condition holds true. Typically, edge conditions are used to 
trigger time-based composites items, such as audio, video, 
animation, and state based conditions are used to trigger 
45 non-time -based assets such as text, graphic, and box. If the 
:offset attribute is specified in an element, and if the element 
has a visual property, then when that asset is enabled it is 
displayed at an offset relative to the position of the item. 
Otherwise, the asset is displayed at the absolute position 
so given in that composite item. 

The list creates an instance of the item template for each 
item in the list. How does the list know how many items it 
has to create, and what do we do if we want to have different 
value for an element in each instance of the item template. 
Both these are provided by : item Values attribute. Its value is 
either a string or a reference (~) to a value item that contains 
the value string. The value string has a new-line separated 
substring for each item in the list. So the number of such 
substrings is the number of items in the list. Now, each 
substring can in turn be made up of zero or more tab 
separated substrings that provide a value for instances of 
elements that have requested a value. The way the list knows 
whether a list element needs a value is if the field it refers 
to has a indirection "~" in an appropriate attribute of the 
field. For each type of field the list checks a predetermined 
attribute for indirection, or no attribute can be indirected. 
For text and :textlnput fields, it is the textvalue attribute. For 
timeEvent field, it is the first action parameter. For graphic, 
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audio, video and animation it is the file attribute. Box, List, OnWrap triggered on either wrap above or below, 

and Script fields cannot have any indirected attribute. hilite: Ahilite composite item is used to designate an item on 

The initial state of the list can be specified in the :initial- the screen and the associated action that should be taken 

State attribute. The value of initialState is a state string, or when the item is cn0 sen is activated. Pressing the arrow 

a reference to value item that contains the state string. The 5 buVtDns moves between hilites. When a hilite is selected, 

state string contains a single alphabet for each list item that ^ {& enabled when ±c ^ is choseaj tfae 

hastheencodedstateoftheitem.^eencodmgisasfoUows. for fa rformed 

Upper case means the item is enabled, and lower case means r , ... „ • * 

disabled. Once that information is extracted, the remaining A xn V » a o£ action^parameter pairs. A 

encoding is case insensitive. . scn P l » mn when an f"^ occurs that ma,ches ,he name 

ao of the script. It is used when you want an event to cause 

C=>cursor item . f. , , c / 

n . A , . j several actions instead of only one. 

B->cursor item+selected timer: A ^ composite item is ^ to ^ a ^ and 

A«>cursor item+selected+first visible item spedfy me associated action thal should be taken when 

S=>selected me timer expires. The timer is started when first enabled 

T=>selecetd+first visible item 15 a nd { s disabled when it expires, A timer can also be 

Y=>first visible item disabled before it expires. The time value specifies the 

Xo>first visible item+cursor item expiration time, in seconds, following the enabling of the 

If the initialState attribute is indirected to a value item, timer, 

then the current state of the list is also written out to the transition: A transition item is used to specify how a com- 

value item when either a ListSaveState message is sent to the 20 posite or composite item is visually enabled or disabled, 

list or the list is disabled. , The name of the transition is passed as a parameter to 

Trigger Conditions Enable, Disable, or TransitionTo. The type attribute deter- 

Each element in an item template has a trigger condition. mines which of several transitions is used. The frames 

A trigger condition can be based on state (eg. OnCursor, parameters determines the length of the transition. Some 

OnSelect), or negation of a state (OnCursorNot, 25 0 f the transition types iise additional parameters. Transi- 

OnSelectNot), or on state transition (eg. OnCursorln, tk)n { iaclude Nqq ^ Zoom> Slide> FadeBlack, and 

OnSelectln). If the item is not visible then it does not process Wipe 

any messages. When an item becomes visible it is sent a buttonE ventHandler: A button event handler item specifies 

OnVisibleln+OnVisib e message. When an item is sent a associated action that should be taken when a button 

message it checks all its elements and the ones that are ^ ^ d _ 

nggered by the me ^ e / nab ^ fi es the event type and the button as well as any paxam- 

to. If the trigger is based on a state and the state no longer ff J r 

holds, then the referenced composite item is disabled. At ^^rs that should be passed to the action, 

some point when the item goes out of view (by scrolling or streamEventllandler: A stream event handler item specifies 

hiding) all composite items referenced by its elements are the associated action that should be taken when a stream 

disabled. 35 event occurs m the runtime session. The developer speci- 

The set of trigger conditions include: fies the event type and the stream composite item (video 

OnCursor state based trigger that fires as long as item has or audio) as well as any parameters that should be passed 

cursor to the action. Stream marker events allow the developer to 

OnCursorln transition trigger that fires when an item gets trigger an action when a marker embedded in the stream 

cursor. If the list scrolls without changing the scroll item, 40 is encountered by the stream playback system. For these 

this condition will not be satisfied whereas OnCursor will type of events, one must also specify a string that iden- 

be. This will normally control a composite item with a tifies the marker that is to be trapped. Note that some 

time based asset such as audio. networks may not support the embedding of markers in 

OnCursorNot state based trigger that will fire as long as item the stream assets. 

does not have cursor. This is useful in creating a unique 45 compositeEventHandler: A composite event handler item 

visual appearance for cursor item triggered on OnCursor specifies the associated action that should be taken when 

and all other items having a normal appearance an trig- a composite is entered (opened) or exited (closed) by the 

gered on OnCursorNot. runtime session. The developer specifies the event type as 

OnSelect well as any parameters that should be passed to the action. 

OnSelectln so transition: A transition item specifies a visual transition 

OnSelectNot effect that should be used when a new composite is 

Onenable opened. The developer references the transition item 

OnEnableln when calling the Open and TransitionTo actions. 

OnDisable library: A library composite item provides a mechanism for 

OnDisableln 55 adding actions to the action name space of a composite. 

OnAction The enclosing composite and any composites that del- 

OnToggle egate behavior to the enclosing composite, will look first 

OnToggleNot in this library for an action when the library item is 

OnVisible enabled. Disabling a library item removes the actions it 

OnVisibleln 60 contains from the name space. This type of item will be 

OnWrapAbove last viewable item of the list that is wrapped primarily useful to template composites. 

gets this message custom: A custom composite item is used to store or refer- 

OnWrapBelow first viewable item of the list that is wrapped ence application-specific data. It can store one of three 

gets this message. When both the first and last viewable types of data: character strings, binary data or a filename, 

items are visible, the item that is across the boundary from 65 value: A value composite item provides a level of indirection 

the cursor is sent a wrap above/below message as appro- between a reference to a file or string value and the actual 

priate. filename or string. This is useful, for instance, when 
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creating template composites. Actions in a template can 
reference a value item for such things as the filename 
associated with a video. Other composites can then pro- 
vide and populate the value item with data (e.g. a 
filename) that is specific to their needs, 
textinput: A textlnput composite item is used to present a 
single line of editable text in a rectangle on the screen. It 
has some attributes in common with a text item, namely, 
font, foreground and background color, which are used 
just as in a text item. The textValue attribute is used to set 
the initial text. A textltem maintains a cursor indicating 
the current editing position in the line. The initial position 
of the cursor is before the first character in the input text. 
The cursor can be moved a single position to the left or 
right by sending "CursorLeft" or "CursorRight" action 
respectively to the textlnput item. A "Backspace" action 
deletes the character to the left of the cursor. Currently, a 
textlnput item accepts numeric input only, which is 
mapped to ButtonO through Button!). The input number is 
inserted to the right of the cursor. When the pasword 
attribute is set to true, an asterisk is displayed for each 
character. This is useful for entering a password. If the 
inputType is alphaNumeric, then the numeric input is 
converted to letters, using the mappings on a telephone 
keypad. 

animation: A animation composite item is used to present an 
animation. The framesPerSec attribute takes a floating 
point number as its value so that you can use values like 
0.5. 
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Action 


Parameters 


Description 




Open 


Composite 


Opens the composite in 
addition to (layered on 
top of) any currently 
open composites. 


40 


Close 


Composite 


Close the composite 
without affecting any 
other currently open 
composites. 




Transition 


Composite 


Close all of the current 




To 


[transition] 


composites, and open the 


45 






specified composite. In 






between, display the 








transition. 




Enable 


nameString 
[transition] 


Enable the item in the 
composite whose name is 








nameString. 


50 


Disable 


nameString 
[transition] 


Disable the item in the 
composite whose name is 
nameString. 


EnablcGroup 


groupNameString 


Enable all the items 
whose group is 
groupNameString. 




DisableGroup 


groupNameString 


Disable all the items 
whose group is 
groupNameString 


55 


LogUserEvent 


userEventString 


Log an application 
specific event string. 




Quit 


result 


Quit the runtime 
returning result to the 
app that started the 
runtime. 


60 


SetValue 


valueName 
value 


Dynamically set a value. 




Go Back 




Go back to the previous 
composite. 


65 
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The following actions provide access to an application 
running on the server. 1 



ServerConnect serverAppNamc 



ServerSend 



ServerSendAsync 



ServerDisconnect 



15 



server App Name 

action 

parameters 

result Value Name 

serverAppNamc 

action 

parameters 

callbackName 

callbackParams 

server App Name 



Create a connection to an 
application running on a server. 
Send action and parameters to a 
server, wait for a reply, and store 
the result in result ValueName. 

Send action and parameters to a 
server. When the reply arrives, 
pass to reply and callbackParams 
to the callAction. 

Remove a connection to an 
application running on a server. 



The following actions provide playback controls for video 
streams. They are not normally used by an application 
because this is provided as part of the system template 
composite. 



StreamPause 



StreamRewind 
StreamGoto 



Stream Volume 



Str ea mFastForward 



streamName Action to pause streamName if it is 
playing or start if it is paused. 

streamName Action to rewind streamName. 

streamName Action to move the streamName to 

markerName marker Name ("starf * and "end" are 
predefined markers for all streams). 

streamName Change the playback volume of a 

volume stream (volume goes from 0-11). 

streamName Action to fastForward streamName. 



The following actions are not normally used by an appli- 
cation. They may be useful for debugging. 



DumpDeep 

DumpTimers 
Print 
Debug 
PressButton 

DumpMem 
Reload 



Help 
Dump 

DumpRemote 



[composite Name] Print composite and all of its 
templates. 

Print the list of active timers, 
text Print text to standard output. 

■ Enter the 3 DO debugger. 

Simulate hitting a button on the 

remote control. 

Print the list of heap blocks, 
[composite Name] Reload the composite and contents 

from the server, default is the current 

composite. 

Print a list of Actions. 
Debug action to print current 
composite to debug window. 
Debug action to print remote object 
table of contents to debug window. 
Debug action to print history of 
recent composites to debug window. 



The following actions are not normally used by an appli- 
cation. They are normally sent by the server to control how 
events are logged. 



SendEvents address Send all events to address as they occur. 

LogEnablc Start logging events. 

LogDisable Stop logging events. 

LogFlush Request that the log be written to storage. 

LogAll Log all events executed. 

LogEvents Log only the low lever user and time 
events. 

LogActions Log only the high level actions executed. 
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COMPOSIT B DESCRIPTION LANGUAGE KEYWORDS 

composite 

( composite :name compos iteName 
[:templates (compositeName*) ] 
[:infoItem infoltems] 
[compositeltenT] 

composite I tern 

text | graphic | video | audio |list |hilite 
| timerEventHandler |buttonEventHandler 

| streamEventHandler 

| compositeEventHandler 

| transition | library | f ont | custom lvalue 
| text Input 

itemAttributes 

[:name itemNameString] 

[.-enabled boolean] 

[ : group string ] 

[ : shared boolean] 

[ : layer integer] 

[: transparent Black boolean] 

[: transparency integer] 

[: override inner itanceType] 

[: preview boolean] 
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[:infoItem infoltems] 

text 

(text 

it emAt tributes 
5 : text Value stringRef nee : 

:font itemNameString 

: wrapped boolean 

rleftMarging integer 

rtopMargin integer 
10 :position position 

justification justification 

: vertical Justification justification 

:characterSpacing integer 

rlineSpacing integer 
15 : rectangle rectangle 

: f oregroundColor color 

: backgroundColor 

) 

box 
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(box 

itemAt tributes 
: thickness integer 
: rectangle rectangle 
5 : foregrounded or color 

:backgroundColor color 

) 

font 

(font 

10 itemAttributes 
:name string 
:file f ileNameRefnce 

) 

graphic 
15 (graphic 

itemAttributes 
:position position 
; rectangle rectangle 
file f i 1 eNameRe f nc e 

20 ) 
video 

(video 

itemAttributes 
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:position position 
: rectangle rectangle 
:file f ileNameRef nee 
:loop boolean 

: lastFrameStaysVisible boolean 
:keepResident boolean 



audio 

(audio 

itemAttributes 
:file f ileNameRef nee 
; loop boolean 
:keepResident boolean 

) 

animation 

(animation 

itemAttributes 
: rectangle rectangle 
:file f ileNameRef nee 
:loop boolean 
:keepResident boolean 
frame sPerSec integer 
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list 

(list 

itemAt tributes 

: rectangle rectangle 
5 rpositions ( Offset* ) 

:wrapCursor boolean 

rwrapList boolean 

: singleSelect boolean 

ifixedCursor boolean 
10 : f ixedCursorlndexinteger 

:autoScrollMargin integer 

:autoScrollCount integer 

:hideDisabled boolean 

rmaxWhiteSpaceAbove integer 
15 rmaxWhiteSpaceBelow integer 

: itemTemplate { listElement * ) 

:itemValues stringRefnce 

: initialState stringRefnce 

) 

20 listElement 

{ : ref itemNameString 
: cond Condition 
[ : qual integer ] 
[: offset Offset ] 

25 ) 
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Condition is one of 

OnVisible 

OnVisibleln 

OnCursor 
5 OnCursorln 

OnCursorNot 

OnSelect 

OnSelectln 

OnSelectNot 
10 OnEnable 

OnEnableln 

OnDi sable 

OnDisableln 

OnToggle 
15 OnToggleNot 

OnWrapAbove 

OnWrapBelow 

OnWrap 

script 
20 (script 

itemAttributes 
actions actionList 

) 

actionList 
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[nameString stringRef erence ] 1 



hilite 

(hilite 

itemAttributes 

:item itemNameString 

:hilited boolean 

: action nameString 

: actionParameters stringRef nee 

) 



timerEventHandler 
{timerEvent 

itemAttributes 

[:time integer ] 

[: ticks integer ] 

:eventType timerEventType 

: action nameString 

: actionParameters stringRef nee 



buttonEventHandler 
(buttonEvent 

itemAttributes 
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: button buttonID 
:eventType buttonEventType 
: index integer 
taction nameString 
:actionParameters stringRefnce 

) 

streamEventHandler 

{streamEvent itemAttributes 
: stream itemNameString 
:eventType streamEventType 
[ : marker integer ] 
taction nameString 
actionParameters stringRefnce 

) 

compositeEventHandler 
(compositeEvent 

itemAttributes 

:eventType compositeEvent Type 

taction nameString 

: actionParameters stringRefnce 

) 

transition 

(transition 
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itemAttributes 



: transit ionType trans it ionType 



[:in boolean ] 



5 



[iframes integer ] 
[rinitialX integer ] 
[:initialY integer ] 



transit ionType 

is one of: None, FadeBlack, Dissolve, Wipe, Slide, 

10 Zoom 

library 

(library 

itemAttributes 
:file f ileNameRefnce 
15 [: runtime boolean ] 



custom 



(custom 



itemAttributes 



20 



customValue 



customValue is one of 
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:data stringRefnce 
:hexData stringRefnce 
:dataFile f ileNameRefnce 



value 

(value 

it emAt tributes 
text stringRefnce 

) 



text Input 

(text Input 

itemAt tributes 

:textValue stringRefnce 

: font itemNameString 

: input Type numeric | alphaNumeric 

: password boolean 

: charSpacing integer 

: f oregroundColor color 

:backgroundColor color 

:cursorColor color 

: rectangle rectangle 

maximumLength integer 



inf oltems 
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(infoltem * ) 

infoltem 

{: string string ) 

itemNameString 
5 nameString 

boolean 

is one of: true or false. 

integer 

is an integer 

10 f ileNameRef nee 

is one of: filename f ileNameltem 

stringRefnce 

is one of : string stringltem 

overrideType 
15 is one of: extend, replace 

nameString 
string 

must not contain spaces or special characters . 
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f ileNameltem 

is a value item name preceded by a - all 

enclosed within double quotes. 

strinltem 

5 is a value item name preceded by a - all 

enclosed within double - quotes . 

Offset 

(hOffset vOffset ) 

hOffset 
10 integer 

vOf f set 

integer 

color 

( red green blue ) 

15 red 

integer 

green 

integer 
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blue 

integer 
buttonlD 

is one of: ButtonMap, ButtonGuide , ButtonVideo, 
ButtonO, Buttonl, Button2, Buttons, Button4, 
Buttons, ButtonG, Button7, Buttons, Button9, 
Bu t tonUpChanne 1 , Bu t t onDownChanne 1 , 

ButtonLastChannel, ButtonExit, Buttonlnfo, 
ButtonSelect , ButtonPrevious, ButtonNext, 
ButtonPower, ButtonRewind, ButtonPause, 
ButtonFast Forward, ButtonMute, ButtonUpVolume, 
BuKonDown Volume , ButtonLeft, ButtonRight, 
ButtonDown, ButtonUp 

buttonEventType 

is one of: ButtonPressed, ButtonStillDown, 
ButtonReleased 

streamEventType 

is one of: StreamStart, StreamEnd, StreamMarker 

compositeEventType 

is one of EnterComposite, ExitComposite 

timerEventType 
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is one of: TimeDelay UserDelay 

trans itionType 

is one of: None, FadeBlack, Dissolve, Wipe 

justification 

5 is one of: left, center, right, top, bottom 

position 

(left top) 

rectangle 

{left top right bottom ) 

10 thickness 

integer 

left 

integer 

top 

15 integer 
right 

integer 
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bottom 



integer 

compos it eName 
string 

string 

is a character string. It must be enclosed within 
double quotes. 
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What is claimed is: 

1. For use in a multimedia application development 
computer system, a method for describing functionality of a 
multimedia application for use on an interactive network 
employing a client-server architecture, the method compris- 5 
ing: . 

receiving signals via the computer system, the signals 

representing a plurality of composites; 
storing the plurality of composites in ASCII text file, each 

composite having a plurality of composite items includ- 
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ing audio and video, each composite describing a 
sequence and a position of a plurality of multimedia 
assets to be executed by a player wherein the composite 
description includes at least one internal event handler 
used by the player to transition to different composites 
and modify the composite items in a composite when 
an interval event occurs, at least two of the plurality of 
composites being linked by an action. 

***** 
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